Methods and apparatuses for printing three dimensional images

ABSTRACT

Systems and methods for printing a 3D object on a three-dimensional (3D) printer are described. The methods semi-automatically or automatically delineate an item in an image, receive a 3D model of the item, matches said item to said 3D model, and send the matched 3D model to a 3D printer.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.12/479,644, filed Jun. 5, 2009, which claims priority under 35 U.S.C.§119(e) to U.S. Provisional No. 61/059,575, filed Jun. 6, 2008. Thedisclosures of the above-referenced prior applications, publications,and patents are considered part of the disclosure of this application,and are incorporated by reference herein.

BACKGROUND

1. Field of the Invention

This invention relates to various methods and apparatuses for printingthree-dimensional objects in three-dimensional printers usingthree-dimensional mathematical/numerical representations of thethree-dimensional objects.

2. Description of the Related Technology

Presently, three-dimensional (3D) printers are available to consumers.For instance, Automated Creation Technology sells models such as theFab@Home 3D Production Platform. These 3D printers “print” 3D objects byspraying paper particles to form a 3D shape, curing it by heat and thencoloring the surface of the cured printed object. Such 3D printersreceive a 3D model (i.e., a mathematical and/or numerical representationof a 3D object) and print the object being represented by the received3D model.

An example of 3D printing is described in “A Whole New Dimension,” AlunAnderson from The World 2008 and “How 3-D Printing Figures To Turn WebWorlds Real,” Robert Guth, Wall Street Journal, Dec. 12, 2007, Page B1.

However, the generation of 3D models is a rather cumbersome technologythat does not allow 3D models to be readily generated. Typically, thegeneration of 3D models would require highly sophisticated users and/orstereographic machines. Moreover, most 3D representations do notrepresent an item in action or posed containing background attributesfound in either a fictional or non-fictional setting. In other words,for a wider use of 3D printers, techniques to generate easily 3D modelsare desired.

An example for generating a 3D model is described in the followingreference, “Computational Geometry for Design and Mfg” Faux, I. D.,Pratt, M. J., 1979 and “Fundamentals of Interactive Computer Graphics,”Foley J., vanDam, A., 1982.

SUMMARY OF CERTAIN EMBODIMENTS

Accordingly, apparatuses and methods for printing a 3D object on a 3Dprinter are described. In some embodiments, the methods may includesemi-automatically or automatically delineating an item in an image,wherein the item is selected by a user, receiving a 3D model of saiditem, matching said item to said 3D model, and sending said matched 3Dmodel to a 3D printer.

In some embodiments, a method of printing a 3D object in a 3D printercan include the steps of selecting a point in an object of interest inan image, automatically delineating the object of interest in the image,and selecting a wire-frame 3D model of the object of interest, whereinthe wire-frame 3D model may include shape information of the object ofinterest. Such embodiments can also include the steps of mappinginformation from a portion of image representing said delineated objectwith the selected wire-frame 3D model, and transmitting the mappedinformation to the 3D printer to be printed. In one example, the mappedinformation is a 3D model for printing the object of interest as araised-contoured surface. There can also be more than oneraised-contoured surface. In another example, the mapped information isa 3D model for printing said object of interest as a freestandingfigurine on a platform. The object of interest can be an image of aperson or persons, an animal, a figure, or any other object depicted inan image.

In one example embodiment, the 3D wire-frame model can be automaticallycalculated from stereoscopic set of images. In another example, the 3Dwire-frame model is pre-generated and stored in a database with acopyright protection.

The mapping step mentioned above can further include the steps ofbreaking the 3D wire-frame model into 3D components, determining theposition of the 3D components in relation with respect to the imagerepresenting said delineated object, and coloring the 3D components withthe color information from the image representing said delineatedobject.

Examples of certain embodiments of apparatuses that may be used toimplement one or more aspects of the invention, including performing theabove-described methods are illustrated and described hereinbelow, forexample, in FIGS. 1, 2, 5, and 6-8. In some embodiments, a system isconfigured to semi-automatically or automatically delineate auser-selected item in an image, receive a 3D model of the item, matchthe item to the 3D model, and send the matched 3D model to a 3D printer.In some embodiments a system for printing three dimensional imagesincludes an input information processor, an object model processor, amultiple frame abstraction processor, an object abstraction processor,and an object formation processor. Such a system can be configured toreceive broadcast/communication signals and associated information,calculate a 3D model based received wire-based model data, and calculatea 3D model based on the video capture frames, delineate an object ofinterest in the video frames that will be used to generate the printable3D model, generate a data file in a format readable for 3D printers, andsend the data file to the 3D printer.

An example system for printing three dimensional images may include aninput information processor configured to receive a plurality of videoframes and information relating to a selection of a point in an objectof interest in said plurality of video frames, an object model processorconfigured to receive a wire-frame 3D model of the object of interest,wherein the wire-frame 3D model includes shape information of the objectof interest, an object abstraction processor configured to automaticallydelineate the object of interest, and an object formation processorconfigured to map information from a portion of image representing saiddelineated object with the selected wire-frame 3D model and configuredto transmit the mapped information to the 3D printer to be printed.

In another example system, the object formation processor is furtherconfigured to generate a 3D model for printing the object of interest asa raised-contoured surface, configured to generate a 3D model forprinting said object of interest as a freestanding figurine on aplatform, or configured to generate a 3D model for printing a persondepicted in the plurality of video frames. The object formationprocessor can be further configured to break the 3D wire-frame modelinto 3D components, configured to determine the position of the 3Dcomponents in relation with respect to the plurality of video framesrepresenting said delineated object, and/or configured to color the 3Dcomponents with the color information from the plurality of video framesrepresenting said delineated object.

Another example of a system may include a multiple frame abstractionprocessor configured to calculate the 3D wire-frame model from theplurality of video frames, and the source of the plurality of videoframes is a stereoscopic video. Also in another example the system mayinclude a database with 3D wire-frames with copyright protectioninformation for each 3D wire-frame.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of embodiments of the invention, and manyof the attendant advantages thereof, will be readily apparent as thesame becomes better understood by reference to the following detaileddescription when considered in conjunction with the accompanying drawingin which like reference symbols indicate the same or similar components,wherein:

FIG. 1 is a block diagram illustrating an overall interface scheme of anexample embodiment;

FIG. 2 is a block diagram illustrating data processing techniques withina television in an example embodiment;

FIG. 3 is a flow chart illustrating data processing techniques togenerate a 3D model, including surface color and pose information, fromat least video data and a wire-frame 3D model in some exampleembodiments;

FIG. 4 is a flow chart illustrating data processing techniques togenerate a 3D model including surface color and pose information fromstereoscopic images generated from multi-frame images according to anexample embodiment;

FIG. 5 is a block diagram illustrating feedback connectivity with a userand a television for generating a 3D model according to an exampleembodiment;

FIG. 6 is an illustration depicting steps of selecting an object ofinterest;

FIG. 7 is a block diagram illustrating selecting a wire-frame 3D modelfrom a database of wire-frame 3D models; and

FIG. 8 illustrates an example of selecting a 3D model of interest andselecting a 3D printer.

DETAILED DESCRIPTION OF CERTAIN EMBODIMENTS

The following detailed description is directed to certain specificembodiments. However, other embodiments may be used and some elementscan be embodied in a multitude of different ways.

As an initial matter, terminologies to be used to describe exampleembodiments are provided below as best they can be expressed becausevarious concepts herein are novel and well known terminologies may notyet exist. Moreover, the description should not be interpreted as beinglimited to only technologies and concepts described herein because thepurpose of the description provided herein is for conveying conceptsrelating to example embodiments of the present invention and is notlimited only to example descriptions.

User interface enabled video devices (UIEVDs) are electronic devicesthat can display video and allow users to point and click on a portionor portions of displayed video or pictures. Examples of such devicesare: TV, IPOD, IPHONE, etc.

A three-dimensional model (3D model) is a mathematical and/or numericalrepresentation of a 3D object. An example of 3D model format isdescribed in DXF Reference Guide for AutoCAD 2009 available on theAutoDesk website (http://usa.autodesk.com). A wire-frame 3D modelcontains information relating to the item of interest which couldinclude the object itself, secondary items in the scene, and backgroundattributes. A 3D model can also include information relating to thesurface color of the object as well as information relating to the poseof the object to be printed. Moreover, information such as surfacetexture, illumination properties, and geometry topology is optionallyincluded in the 3D model. Such a 3D model is referred to as a full 3Dmodel herein.

FIG. 1 illustrates an example embodiment of an overall interface scheme,which can include a television (TV) 101, a workstation 103, and a 3Dprinter 105. As used herein, “TV” is a broad term that refers to animage display device coupled with certain circuitry to receive anddisplay data. The TV 101 exemplifies both TV's having the display aridsaid circuitry housed together in a single unit as well as TV's having adisplay housed separately from one or more portions of said circuitry.In some examples, such circuitry is configured in one or more separatecomponents that can be purchased or obtained separately from the TV 101,and that are connected to communicate with the TV 101.

In the embodiment illustrated in FIG. 1, TV 101 includes internalcircuitry such as data interface unit 107 and data receiver unit 109.Data interface unit 107 in turn can include one or more communicationmodules that communicate using one or more wired or wirelesscommunication protocols, for example, TCP/IP, 802.11, Bluetooth, and/orWiFi. The data receiver unit 109 can include one or more devices toreceive data, for example, model information, television or broadcastsignals, and other information including copyright information. In thisembodiment, data receiver unit 109 includes a digital receiver 111configured to receive digital data such as TV signal 113, 3D modelinformation 115, and other information that is associated with thereceived digital data, for example, copyright information 117. Modelinformation 115 can also be received by the data receiver unit 109 usingTCP/IP (or equivalent Internet protocol) 121. Data receiver unit 109 canalso include an input device to receive user input by including an IR/IOdevice 119 and/or a device configured to communicate using the TCP/IPcommunication protocol 121. TV 101 is configured to communicate withworkstation 103 and 3D printer 105 over communication links.

In some embodiments, the 3D printer 105 is co-located with the TV 101and the user such that the user can simply remove a printed item fromthe 3D printer. In other embodiments, the 3D printer 105 is located at aplace remote from the user. Once the item is printed, the user maypick-up the printed 3D item at the remote location, or have the 3D itemshipped or transferred to the user's location. For example, a relativelyinexpensive 3D printer 105 may be located in a user's home;alternatively, a high-end 3D printer 105 may be located at a printingkiosk or other business that provides high quality 3D printing servicesfor numerous customers/users.

FIG. 2 illustrates an embodiment showing some of the data processingtechniques that can be configured within the TV 101, for example, insoftware or hardware. In some embodiments, the data processingtechniques are configured on one or both of the data interface unit 107or the data receiver unit 109. In other embodiments, the data processingtechniques are configured on components located outside of the TV 101housing and that communicate with the TV 101. In the embodimentillustrated in FIG. 2, the TV 101 includes input information processor201, which is configured to receive TV signals. In some embodiments, theinput processor 201 is implemented in data receiver unit 109 (FIG. 1).The TV signal can be a conventional analog signal or digital signal frombroadcasters which can be transmitted over air, cable, or satellite.Input information processor 201 processes the received TV signal andconverts it into video frames, which can be conjugated stereoscopicimage frames in some embodiments. The TV signal path can also be used todownload a 3D model. The TV signal path can also be used to downloadcopyright information associated with the 3D model if such informationis available. Input information processor 201 can also receive userselection information, indicating which object within the video framesthe user desires to be printed by the 3D printer. In one example, a usercan select a person(s) in an image or select another other object (forexample, a sport figure or a child).

TV 101 also includes an object model processor 203 configured tocalculate a printable 3D model with color and pose information based onthe received wire-frame 3D model, video frames (includes main subjectand background), and user selection information. A multiple frameabstraction processor 205 is configured to calculate the 3D model basedon the video captured frames. In some embodiments, the multiple frameabstraction processor 205 calculates the 3D model based solely on thevideo capture frames. An object abstraction processor 207 is configuredto delineate the item of interest in the video frame(s) that will beused to generate the printable 3D model. The results from the objectabstraction processor 207 can be provided (directly or indirectly) toboth the object model processor 203 and the multiple frame abstractionprocessor 205. An Object Formation Processor 209 integrates the resultsfrom 203 and 205 into a readable format for most common 3D printers. Thegenerated 3D model with color and pose information is then sent to 3Dprinter 105. In some cases, the printer can be attached to a host devicesuch as workstation 103 in FIG. 1. It should be noted that the ObjectFormation Processor 209 can also compensate for in-scene motion of theobject of interest, for camera motion of the object of interest, and/orfor color imbalances of the object of interest.

In particular, the object formation processor 209 generate a 3D modelfor printing the object of interest as a raised-contoured surface, a 3Dmodel for printing the object of interest as a freestanding figurine ona platform, and/or a 3D model for printing a person depicted in theplurality of video frames. The object formation processor 209 can alsobreak the 3D wire-frame model into 3D components, determine the positionof the 3D components in relation with respect to the plurality of videoframes representing the delineated object, and color the 3D componentswith the color information from the plurality of video framesrepresenting the delineated object.

Using various example components described above in connection withFIGS. 1 and 2, data processing techniques to generate a 3D modelincluding surface color and pose information is described by referringto FIG. 3. While viewing a TV program such as sports program (e.g.,baseball, football, golf, basketball, etc.) or such as movies, a usermay be interested in printing a figurine of a particular pose by aplayer (for example, a baseball player catching a ball or a golf playerswinging a driver). In such an instance, a user can freeze the frame andselect the portion of the image frame (for example, the ball player) tobe printed in a 3D printer. In other words, a user selects incomingprogramming (or whatever video is being viewed) to capture (step 301) animage of player that the user is interested in printing.

After allowing the user to select a portion of the framed image, at step303 the example embodiment is configured to allow the user to select awire-frame 3D model of the player. Such a wire-frame 3D model of aparticular player may include 3D wire frame skeletons, generic skins,texture maps, attributes (e.g. predetermined colors), and lightingconstraints. Moreover, the model may contain the physical limitation ofthe item of interest (e.g. physical flexibility, etc.). In an exampleembodiment of the present invention, a user is allowed to access adatabase with numerous 3D models of various individuals. The user canthen match the image that he/she selected to the 3D model of the sameindividual from the database.

In one embodiment, accessing the database with wire-frame 3D models canbe free of charge, or accessing the database can be a fee based service.If a fee based service is provided, before the requested 3D model isdownload, whether such service can be provided or not is checked. Inother words, in some embodiments, the data processing functionalitydetermines whether it is legal to download a 3D model (step 305) (forexample, if previous usage permissions have been granted). If it islegal, the selected 3D model can be downloaded (step 307), and 3Dcopyright information can also be downloaded (step 309). To conform tointellectual property requirements that may be associated with theprinted product, the 3D copyright and/or trademark information can bedownloaded to be displayed as part of the printed product. The 3Dcopyright material may be added to the printable 3D product to ensurecompliance with trademark restrictions. In parallel or in sequence, inthe example embodiment, the video frame that contains the user selectedportion is captured (step 313) and then reformatted (step 315) into anoptimal format for performing frame matching. The reformatted image datais then matched with the downloaded 3D model, and the result is sent to3D printer 105 (step 319), or stored to be printed later. For example, auser may store a number of 3D objects and at a later time print one ormore of the 3D objects on a high-end 3D printer at a remote locationfrom the user, for example, at a company or 3D printing kiosk that usesa high-end 3D printer to print a variety of 3D objects commercially. Theuser then may pickup the one or more objects at the remote location orhave the 3D objects shipped from the remote location to the user. Itshould be noted that the image can be compensated for in-scene motion ofthe object of interest, for camera motion of the object of interest,and/or for color imbalances of the object of interest

FIG. 4 is a flow chart illustrating data processing techniques togenerate a 3D model including surface color and pose information fromstereoscopic images generated from multi-frame images of an exampleembodiment of the present invention. In this example embodiment, thedatabase with wire-frame 3D models is not available or not accessible.In such an embodiment, a 3D model can be generated using multipleframes. For instance, a 3D model can be generated from a pair ofstereoscopic images. These data processing techniques can be performedby, for example, the systems illustrated in FIGS. 1 and 2.

Based on different number of frames and various perspectives of frames,different levels of 3D models can be generated. For instance, multipleimages taken of a 3D item of interest can be used to create a 3D modelof the item. Given that all the surface area of the item of interest canbe imaged, a complete 3D model of the item of interest can be derived.Depending on the geometry of the item of interest, it is possible toperform a valid representation with a small number of video frames (e.g.6). A multi-lighted, multi-angle 3D model generation system wasdeveloped by Adam Baumberg from the Canon Research Centre Europe thatfaithfully restored a complete 3D model from 20-25 frames. The system isdescribed in “Blending images for texturing 3D,” Adam Baumberg, CanonResearch Centre Europe, which is incorporated by reference herein in itsentirety. Additionally, an algorithm is described in U.S. Pat. No.6,856,314, called “Method and system for 3D reconstruction of multipleviews with altering search path and occlusion modeling,” (for example,at column 4, line 55 through column 5, line 10 and as illustrated by thereferenced figures) to perform full 3D model reconstruction from alimited number of images, which is incorporated by reference herein inits entirety.

With a complete 3D model, a fully developed 3D object can be printedusing a 3D printer. However, the present invention also contemplatescreating other types of models that are less than a complete 3D modeldepending upon the availability of relevant information and/or the userpreference. For instance, a 3D model that represents a raised flatsurface can be generated from two stereoscopic images. The raisedsurface can be a stepped up surface, as compared with the surroundingsurface, and can be outlined by the contour of an object selected by theuser. As an example, if a person is selected by the user in the videoscene, the contour of that person in the image would be raised usingmultiple views to create the 3D perspective. This type of 3D model isreferred to as a 2.5 dimension model within this document for the sakeof convenience.

In another example, two stereoscopic images can be used to generate 3Dmodels to create raised relief of the object of interest. An example ofsuch a 3D model is a relief map. This type of 3D model is referred to asa 3D relief model within this document for the sake of convenience. Adifference between a 3D relief model and a 2.5 dimensional model is thatthe raised surface of a 2.5 dimensional model would be flat no matterwhat the object of interest actually looks like; whereas, the raisedsurface of a 3D relief model would show a 3 dimensional surface.

Now referring back to FIG. 4, in step 401, the user selects 3D modelingoptions to include either 2.5 dimensional, 3D relief, or full 3D. Instep 403, an example embodiment of the present invention determineswhether the 3D option selected by the user can be generated based on theavailable frames. Such an algorithm is described in U.S. Pat. No.6,856,314 (for example, in the specification at column 4, line 55through column 5, line 10, and as illustrated by the referencedfigures). In step 405, the example embodiment of the present inventioncreates a 3D model based on the user preference. In step 407, thecreated 3D model is reformatted into a 3D model that aligns with theprocessing performed in FIG. 3.

FIG. 5 is a block diagram illustrating feedback connectivity with a userand a television for generating a 3D model according to an exampleembodiment. FIG. 5 illustrates the interaction between the user and theTV 101. In this example, a feedback interface 501 can be one or anycombination of devices using protocols such as TCP/IP, 802.11,Bluetooth, or WiFi. The interface device itself can be an IR/IO device,digital receiver, or touch screen. Through the feedback interface, theuser can designate the item of interest on the TV 101. TV 101 mayinclude an object selection processor 503 and model selection processor505. The object selection processor 503 can be configured to perform twodata processing functions, delineating object 507 and delineatingbackground 509. The model selection processor provides the 3D model fromthe external database to 3D model generation 511 using either userinputs through the feedback interface or externally pre-processedinformation. During the delineating object step 507, the item selectedby the user on the image is delineated. During the delineatingbackground step 509, the rest of image minus the object selected by theuser is delineated. Delineation may be performed automatically orsemi-automatically, for example, during an interactive delineationprocess with the user. Some examples of delineation algorithms that maybe implemented are found in the following three publications:

-   -   F. Leymarie and. M. D. Levine, “Tracking deformable objects in        the plane using an active contour model.” IEEE Transactions on        Pattern Analysis and Machine Intelligence. v. 15, n. 6, pp.        617-634, 1993.    -   K.-M. Lam and H. Yan, “Fast greedy algorithm for active        contours.” Electronics Letters. v. 30, n. 1, pp. 21-23, 1994.    -   Active Contours The Application of Techniques from Graphics,        Vision, Control Theory and Statistics to Visual Tracking of        Shapes in Motion by Andrew Blake ISBN-10: 3540762175 ISBN-13:        978-3540762171.

All three publications identified above are incorporated referenceherein in their entirety. Other delineation methods and algorithms mayalso be used. FIG. 6 graphically illustrates the output of thedelineation steps in accordance with some embodiments.

The result of delineated object from the image can then be combined with(or mapped to) a wire-frame 3D model selected by the user to form a full3D model which information relating to the surface colors and pose ofthe object to be printed. The 3D wire-frame model is combined with thecaptured image in a multi-step process. The following list describes thesteps in some embodiments of the process:

-   -   Break the wire-frame 3D model into 3D wire-model components that        can be matched directly with the capture video frames. For        example, 3D wire-model components of a sports figure can be the        head, arms, torso, legs, and feet.    -   Determine the position of the each 3D component in the scenes of        the captured video frames:    -   For a given 3D wire-frame component, determine constraints        imposed by other 3D wire-frame components placed in the scene.        In the example of a sports figure, if the torso is placed first,        the search area and viable search location (for example,        position, orientation) for the head is limited to a small area.        Once the head is placed, the arms, legs and feet can also be        placed.    -   For a given 3D wire-frame component, create multiple simulated        2D images from the 3D wire-frame model at various orientations        (e.g., view points) as constrained by the previous step. The        simulated 2D images can be created using a generic illumination        model in order to robustly match the created image with the        captured image. In other examples, illumination models that        match the actual scene (for example, rainy day, dusk, bright        sunny day with shadows, or the like) can also be used.    -   For a given 3D component, determine the position and orientation        thereof using Principal Component Analysis (PCA). The principal        component analysis (Karhunen-Loeve transform) is a linear        transformation for a sample in n-dimensional space which makes        the new coordinate axes uncorrelated. Using PCA, the individual        3D wire-frame component that is projected into a simulated 2D        image is aligned with the 2D capture images extracted from the        captured frames. An approximation to the Karhunen-Loeve        transform is discussed in “Fast Approximate Karhunen-Loeve        Transform with Applications to Digital Image Coding,” Leu-Shing        Lan and Irving Reed, University of Southern California, Proc        SPIE Vol. 2094, 1993, which is incorporated by reference in its        entirety.    -   Optimize on a global connection distance metric that ensures all        the 3D wire-frame components re-connect to the original 3D        wire-frame model at the proper locations. If the model does not        re-connect properly, as specified by a user threshold, the        process can be re-iterated by discarding the largest incorrect        correspondence and re-calculating the system of simulated 2D        images and 3D wire-frame components.

Finally, the image may be textured onto (for example, fill in withcolors) the full 3D model. The 3D wire-frame model is simplified into atriangular mesh. Since the position and orientation of the 3D wire-framemodel relative to the 2D captured frame(s) are calculated in the stepsdescribed above, the delineated image is projected onto the triangularmesh of the 3D wire-frame model. Three different visibility states thatcan be considered when performing the mapping from the 2D captured imageonto the 3D wire-frame model to include:

-   -   Visible: If a triangle of the 3D wire-frame model is completely        visible in the camera view, the whole triangle can be textured        based on the color information of the delineated image.    -   Hidden: If a triangle is completely hidden in the camera view,        the triangle can be rendered with zero intensity or filled in        with information from another part of the model (for example,        opposite side) based on the user's preferences.    -   Partially visible: The triangles may be subdivided into smaller        triangles that are hidden or visible. Then the appropriate        action can be taken from the above steps and the model may be        textured.

The resulting 3D model is textured with color and shadow and displayedin the appropriate pose, which is referred to as the full 3D model. Atthis point, the object of interest is ready to be printed. Note that themapping can be achieved (and/or improved) if multiple frames or multiplecameras at different angles are used to during the coloring step. Inother words, using multiple frames or multiple cameras at differentangles, the front and back of an object to be printed can be colored inassuming that the frames captured the front and back of the object to beprinted.

In FIG. 7, a database 701 of wire-frame 3D models is illustrated asbeing able to communicate with the user via feedback interface 501.Database 701 includes tables 703 that contain 3D models of objects. Forinstance, a set of tables could contain number of 3D models of movieactors and actresses; another set of tables could contain number of 3Dmodels of football players, and etc. A user using feedback interface 501can send a query request to database 701 asking for a list of 3D modelsin tables 703 for a specific category of objects (or persons). Such aquery is processed database 701 and a responsive list is generated inquery results processing step 707 and result retrieval processing step709. The resulting list is sent back to TV 101 to be displayed. Anexample list 801 is shown in FIG. 8.

In any of the methods and processes specifically described above, one ormore steps may be added, or a described step deleted, without departingfrom at least one of the aspects of the invention. Those of ordinaryskill in the art would understand that information and signals may berepresented using any of a variety of different technologies andtechniques. For example, data, instructions, commands, information,signals, bits, symbols, and chips that may be referenced throughout theabove description may be represented by voltages, currents,electromagnetic waves, magnetic fields or particles, optical fields orparticles, or any combination thereof. The various illustrative logicalblocks, components, modules, and circuits described in connection withthe examples disclosed herein may be implemented or performed with ageneral purpose processor, a digital signal processor (DSP), anapplication specific integrated circuit (ASIC), a field programmablegate array (FPGA) or other programmable logic device, discrete gate ortransistor logic, discrete hardware components, or any combinationthereof designed to perform the functions described herein. A generalpurpose processor may be a microprocessor, but in the alternative, theprocessor may be any conventional processor, controller,microcontroller, or state machine. A processor may also be implementedas a combination of computing devices, e.g., a combination of a DSP anda microprocessor, a plurality of microprocessors, one or moremicroprocessors in conjunction with a DSP core, or any other suchconfiguration. In some embodiments, the functionality of devicesdescribed herein as separate processors may be combined into anembodiment using fewer processors, or a single processor, unlessotherwise described.

Those of ordinary skill would further appreciate that the variousillustrative logical blocks, modules, and algorithm steps described inconnection with the examples disclosed herein may be implemented aselectronic hardware, firmware, computer software, middleware, microcode,or combinations thereof. To clearly illustrate this interchangeabilityof hardware and software, various illustrative components, blocks,modules, circuits, and steps have been described above generally interms of their functionality. Whether such functionality is implementedas hardware or software depends upon the particular application anddesign constraints imposed on the overall system. Skilled artisans mayimplement the described functionality in varying ways for eachparticular application, but such implementation decisions should not beinterpreted as causing a departure from the scope of the disclosedmethods.

The steps of a method or algorithm described in connection with theexamples disclosed herein may be embodied directly in hardware, in asoftware module executed by a processor, or in a combination of the two.A software module may reside in RAM memory, flash memory, ROM memory,EPROM memory, EEPROM memory, registers, hard disk, a removable disk, aCD-ROM, or any other form of storage medium known in the art. Anexemplary storage medium is coupled to the processor such that theprocessor can read information from, and write information to, thestorage medium. In the alternative, the storage medium may be integralto the processor. The processor and the storage medium may reside in anApplication Specific Integrated Circuit (ASIC). The ASIC may reside in awireless modem. In the alternative, the processor and the storage mediummay reside as discrete components in the wireless modem.

Various modifications to these example embodiments may be readilyapparent to those skilled in the art, and the generic principles definedherein may be applied to other examples without departing from thespirit or scope of the novel aspects described herein. Thus, the scopeof the disclosure is not intended to be limited to the examples shownherein but is to be accorded the widest scope consistent with theprinciples and novel features disclosed herein.

What is claimed is:
 1. A method, comprising: receiving a selection of anobject of interest in an image; delineating the object of interest inthe image; determining a wire-frame 3D model to model the object ofinterest, wherein the wire-frame 3D model includes shape information formodeling the object of interest; breaking the wire-frame 3D model into3D components; and generating mapped information by mapping informationfrom a portion of the image representing said delineated object to the3D components of the selected wire-frame 3D model, wherein determining awire-frame 3D model to model the object of interest comprisesautomatically calculating the wire-frame 3D model from a stereoscopicset of images.
 2. The method of claim 1, further comprising transmittingthe mapped information to a 3D printer.
 3. The method of claim 1,further comprising: determining the position of the 3D components withrespect to the image representing said delineated object; and coloringthe 3D components with the color information from the image representingsaid delineated object.
 4. The method of claim 1, wherein said receivinga selection of an object comprises receiving a point in an object ofinterest in the image.
 5. The method of claim 1, wherein the mappedinformation is a 3D model for printing the object of interest as araised-contoured surface.
 6. The method of claim 1, wherein the mappedinformation is a 3D model for printing said object of interest as afreestanding figurine on a platform.
 7. The method of claim 1, whereinthe object of interest is information depicting a person in the image.8. The method of claim 1, further comprising compensating for in-scenemotion of the object of interest.
 9. The method of claim 1, furthercomprising compensating for camera motion of the object of interest. 10.The method of claim 3, further comprising compensating for colorimbalances of the object of interest.
 11. A method, comprising:receiving a selection of an object of interest in an image; delineatingthe object of interest in the image; determining a wire-frame 3D modelto model the object of interest, wherein the wire-frame 3D modelincludes shape information for modeling the object of interest; breakingthe wire-frame 3D model into 3D components; and generating mappedinformation by mapping imformation from a portion of the imagerepresenting said delineated object to the 3D components of the selectedwire-frame 3D model; and storing the wire-frame 3D model in a databasewith a copyright protection.
 12. A system, comprising: an inputinformation processor configured to receive a selection of an object ofinterest in an plurality of video frames; an object abstractionprocessor configured to automatically delineate the object of interest;an object formation processor configured to break a wire-frame 3D modelof the object of interest into 3D components, the wire-frame 3D modelincluding shape information for modeling the object of interest, theobject formation processor being further configured to generate mappedinformation by mapping information from a portion of an imagerepresenting said delineated object to the 3D components of thewire-frame 3D model, wherein the source of the plurality of video framesis a stereoscopic video.
 13. The system of claim 12, wherein the objectformation processor is further configured to transmit the mappedinformation to a 3D printer to be printed.
 14. The system of claim 12,further comprising an object model processor configured to receive thewire-frame 3D model.
 15. The system of claim 12, further wherein theobject formation processor is further configured to compensate forin-scene motion of the object of interest.
 16. The system of claim 12,wherein the object formation processor is further configured tocompensate for camera motion of the object of interest.
 17. The systemof claim 12, wherein the object formation processor is furtherconfigured to compensate for color imbalances in the object of interest.18. The system of claim 12, wherein the system further comprises amultiple frame abstraction processor configured to calculate thewire-frame 3D model from the plurality of video frames.
 19. The systemof claim 12, wherein the object formation processor is furtherconfigured to color the 3D components with the color information fromthe plurality of video frames representing said delineated object.
 20. Asystem, comprising: an input information processor configured to receivea selection of an object of interest in an plurality of video frames; anobject abstraction processor configured to automatically delineate theobject of interest; an object formation processor configured to break awire-frame 3D model of the object of interest into 3D components, thewire-frame 3D model including shape information for modeling the objectof interest, the object formation processor being further configured togenerate mapped information by mapping information from a portion of animage representing said delineated object to the 3D components of thewire-frame 3D model; and a database with wire-frame 3D models withcopyright protection information for each 3D wire-frame model.